Measuring External Face Appearance for Face Classification

Face classification can be defined as the problem of assigning a predefined label to an image or subpart of an image that contains one ore more faces. This definition comprises many sub disciplines in the visual pattern recognition field: (i) face detection, where the goal is to detect the presence of a face on an image, (ii) face recognition, where we assign an identifier label to the detected face, (iii) face verification, where the identity of the subject is given, and we should assure its truthfulness and (iv) gender recognition where the label male or female is assigned to each face image. The information source of a facial image can divided in two sets, depending on the zone of the face. The internal information is composed by the eyes, nose and mouth, while the external features are the regions of the hair, forehead, both laterals, ears, jaw line and chin. Traditionally, face recognition algorithms have used only the internal information of face images for classification purposes since these features can be easily extracted. In fact, most of these algorithms use the aligned thumbnails as an input for some feature extraction process that yields a final feature set used to train the classifier. Classic examples of this approach are the eigenfaces technique (Turk & Pentland, 1991), or the use of Fisher Linear Discriminant Analysis (Hespanha Belhumeur & Kriegman, 1997). Moreover, in the face classification field, there are a lot of security related applications where the reliability obtained by the internal features is essential: notice that the external information is more variable and easier to imitate. For this reason, the use of external features for these securityrelated tasks has often been ignored, given their changing nature. However, with the advances of technology in chip integration, small embedded computers are more integrated in our everyday life, favouring the appearance of new applications not directly related to security dealing with face classification, where the users do not make specific efforts to mislead the classifier. Typical examples are embedded camera-devices for human userfriendly interfaces, user profiling, or reactive marketing. In these cases we consider the external features as an extra source of information for improving the accuracies obtained using only internal features. Furthermore, notice that this consideration can be specially beneficial in natural and uncontrolled environments, where usually artefacts such as strong local illumination changes or partial occlusions difficult the classification task.